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This paper considers the problem of transmitting bahdlimited signals 
using binary signaling over a noise-free channel. An analytical framework 
is presented for the design and analysis of a class of PCM systems where 
peak error is of primary interest. For a specific class of input signals which 
includes deterministic amplitude-constrained bandlimited functions as 
well as bandlimited wide-sense stationary, second-order, random processes, 
results are obtained which provide trade-offs between the sampling rate, 
quantizer and reconstruction filter. 

I. INTRODUCTION 

This paper considers the problem of transmitting bandlimited sig- 
nals using binary signaling over a noise-free channel. A functional 
block diagram of the type of PCM system under consideration is 
shown in Fig. 1.* 

The two major differences between the problem considered here 
and previous work are the measure of system performance and signal 
classes considered. The measure of system performance usually con- 
sidered is related to the integral mean-squared error. 1-3 This 
type of performance measure lends itself to a frequency-domain 
analysis. While this criterion is widely used, it doesn't provide direct 
information regarding the size of the error as a function of time. To 
investigate this time behavior, we use a time-domain approach and 
use the maximum error over time as a measure of system performance. 

Because of the desire to consider input signals that engineers would 
normally call bandlimited [i.e., trigonometric polynomials, sinusoids as 
well as functions in £ 2 (— °°, °°) with finite bandwidth] we treat a 



* For special classes of signals, other types of PCM systems such as DPCM 
and Delta Modulation are sometimes used. These systems will not be considered 
here. 
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Pig. 1— UPCM system. 

somewhat broader class of signals than normally considered in the 
literature. (The input class is usually considered to be a wide-sense 
stationary random process.) 

In this paper, a technique is presented which simultaneously selects 
the sampling rate, quantizer and reconstruction filter in such a way 
as to minimize a bound on the peak error between the reconstructed 
and transmitted-signals. Since our interest centers on studying the 
trade-offs between the various system parameters, we desire precise 
mathematical results which are valid over the entire range of possible 
system parameters. By using an upper bound on system performance 
this aim was achieved for several classes of input signals. Using a 
criterion which evaluates a given encoding-decoding scheme in terms 
of its performance for the worst signal in the input class, a specific 
encoding-decoding algorithm, which will be called Uniform PCM or 
UPCM, is suggested and evaluated. The results are presented in the 
form of a set of normalized curves which plot an upper bound on 
the percentage error associated with the proposed UPCM system as 
a function of a normalized parameter, P , which represents the ratio of 
the bit rate to the bandwidth of the input class. The optimized values 
of the various parameters which define the system can also be deter- 
mined from the plots (these include the sampling rate, the number of 
quantizing levels and the delay associated with the decoder) . 

II. AN ENCODING-DECODING ALGORITHM FOR THE TRANSMISSION OF 
BANDLIMITED FUNCTIONS 

The class B, of functions consists of entire functions of exponential 
order one and type i which are bounded on the real axis. 4 It includes 
all functions in £ 2 ( — °°, co ) having finite radian bandwidth, <r, and all 
trigonometric polynomials of degree [<r].* 

The performance of a given system is defined by 



] denotes integral part. A trigonometric polynomial of degree [<r] has the form 



ioo + T, (o* cos kt + bk sin kt). 
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e = sup sup \\u(t) - g(t;u) || (1) 

ItlO.TI utfl„(M) 

where u(t) is the value of the input signal at time t and g(t; u) represents 
the value of the output signal at time t corresponding to the input 
function u. The input function u is an element of B„ and the values of 
the input and output signals at any time t c [0, T] belong to a normed 
linear space, ft. By proper choice of ft and the norm on ft, a variety of 
different input classes and performance measures can be treated. 
Specifically, define the set B„(M) by 

B„{M) = {x :xtB a , x{t) c ft, || x(t) || £ M V t\. 

In arriving at the proposed algorithm, the following representation 
is used for elements of B a (and hence B a (M):* 

u(t) = £ i*(#)*,(0 (2) 

; ~ — ■ 

where 

8a . . a , 
sin r t sin r t 

•»-— if^ ^" ; (3) 

1- 5 l 1- S l 

e,{C) = e(t - jh), h = t(1 ~ 3) - (4) 

This representation is valid for any 8 t (0, 1), hence 5 may be chosen 
appropriately for each application. The parameter 5 will be called the 
fractional guardband since the time between samples is ir(l — 8) /a 
which is less than the time between samples ir/a which corresponds to 
the Nyquist rate. 

In essence the proposed algorithm is a scheme for approximating any 
element of B ff (M) t by one of a finite set of appropriately chosen func- 
tions. These functions are determined by first truncating the infinite 
series, (2). This truncation process produces an approximation to u(t) 
(over the time interval t c [0, T]) of the form 

lT/h)+L 

u(t) = E «<JK)9,(0. (5) 



* This is a special case of a broader class of representations for elements of fi„ 6 . 
It was chosen because it provided the smallest bound on quantization error. 

t The results presented in this paper are applicable to the class of signals having 
representation (2) with !|u(j7i)|| ^ M. This class is larger than B a (M). 



920 THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1971 

Thus we have replaced the requirement of transmitting an infinite 
number of sample values by the problem of transmitting a finite 
number. To achieve our ultimate objective, these sample values are 
then quantized and the quantized samples are used to reconstruct 
the signal 



[T/h)+L 

c 

= -/. 



g(t)= £ umeM) (6) 



where u(jh) represents the quantized value of u(jh). 

The encoder will therefore consist of appropriate quantization of the 
input samples while the decoder simply represents the reconstruction 
of the truncated series using the quantized samples [i.e., the signal 
g(t) given in equation (6)]. An analog interpretation of the decoding 
process is discussed in Section V. It should be noted that in order to 
construct g(t) according to equation (6), a delay of T + Lh seconds is 
required. The trade-offs between this delay and the accuracy of re- 
construction will become clear as the results are presented. 

Having constrained the general form of the proposed system, we 
now seek to determine the various parameters which define it (e.g., 
sampling rate and quantizer) in such a way as to minimize an upper 
bound on the value of e. Because of the binary nature of the signaling 
which is being considered, the number of quantization levels is con- 
strained to be 2", where v is an integer.* Thus v represents the number 
of bits per sample. The bit rate is then given by 

5 = £b/s. (7) 

It is convenient to define a normalized parameter p, which is given by 

P ~ a ~ j (8) 

where o- is the radian bandwidth of the input class and / is the band- 
width in Hz. In terms of these parameters, from equation (4), we have 

.-!-*. (9) 

Since St (0, 1), the number of bits per sample must satisfy 



1 < v < 



(10) 



* This is a practical constraint and not a theoretical one. 
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In terms of these parameters a simple bound on the reconstruction 
error results. 

The analysis of the reconstruction error, given in the Appendix, 
shows that e, denned by equation (1), satisfies 

where 

T 

— + 2 

K = % , (12) 

Zfc +1 
ir„(v) = sup sup \\u(jh) - H(jh) || (13) 

,• utB„(A/) 

and S is given by equation (9). Thus the actual value of c which is 
achieved by the proposed algorithm may be less than the value e given 
by equation (11). In fact, since the reconstruction formula (6) is inter- 
polator, the error at sample points can never exceed the raw quantiza- 
tion error, <r Q (v). The first term on the right-hand side of equation (11) 
may be viewed as the error due to truncating u(t) as given by equation 
(2) while the second term represents the quantization error. The effect 
of the delay on the error can be easily seen from equations (11) and (12). 

As a design procedure, one might first choose the quantizer which 
minimizes <t,(k) and then determine the value of v [subject to (10)] 
which minimizes the error bound given by e [see equation (11)]. 

In the next sections, several important special cases are considered 
and explicit design curves are presented for these cases. 

III. DETERMINISTIC, AMPLITUDE CONSTRAINED BANDLIMITED FUNCTIONS 

In this case, fi =R (the real line), and ||x|| = |x|. Thus 

B.(M) = \u:utB a , u(t) t R, | u(t) |^IV t\*. 
The quantizer which minimizes a q {v) for this case is shown in Fig. 2. 
The optimal value of <r q (v) is given by 

*m - f • (14) 



* Insofar as information content is concerned, if A/i g u(t) g M 2 , then it is equiv- 
alent to consider \u(t)\ g M, where M = (M 2 - A/,)/2. 
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Fig. 2 — Uniform quantizer. 



Using equation (14), equation (11) becomes 



< i = 



MK 



+ 



U 



T 8L Vs r 



For later use, we define 



MK 



+ 



K M 



t 2 bL y/ 8 2" 



(15) 



(16)' 



For the present case K = 1 and equation (15) thus becomes e ^ e = e. 
The bound represented by equation (15) is valid for any allowable 
set of system parameters. For fixed values of p, T, and L, the value of v 
which minimizes e can easily be found. If we define the normalized 
percentage error as I00(e/2MK ), then Fig. 3 plots this as a function 
of p, using the optimized values of v. These values of v (denoted v*) are 
indicated on the curves. Curves are plotted for K L/K = 5, 10, 20, 40, 



* K is introduced here for the purpose of unifying the results of this section 
and the next. For the class of signals in this section, K can be replaced by unity. 
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Fig. 3a and b — Performance curves. (Notes: 1. For analog implementation, use 
K = 1; delav = (L + 1) h. 2. For digital implementation. K= (T/Lh + 
2)/(T/Lh + 1); delay = T + Lh. 3. x* is the optimized number of bits per 
sample. 4. The optimum sampling rate is l/h = B/v*.) 
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and °° . Since 1 ^ K ^ 2, for a given value of the ratio L/K , one can 
associate any value of L satisfying L/K ^ L ^ 2L/K. Using equation 
(12), the corresponding value of T can then be computed. The delay 
associated with reconstruction in accordance with equation (6) is then 
given by T d = T + Lh. As discussed in Section V, when an analog 
implementation is used for the reconstruction, a value of K = 1 should 
be used and the delay associated with the filter which accomplishes the 
reconstruction is given by T d = (L + l)h. 

To illustrate the use of these curves, consider the problem defined by 
the following parameter values: 

a = ir X 10°, 

B = 6.3 X 10 e b/s. 

Using these values, we compute p= 12.6. From the curves, for L/K = 20, 
we have 50i/M = 4.67 percent, v* = 5. Using M = f , we have e = 0.035. 
Since B = v/h, we have h* = 0.79 X 10" 8 seconds or 1/k* = 1.26 X 10 6 
samples/second. For L = 40, the delay associated with the error [using 
equation (6) to accomplish the reconstruction] is about 32 /is. For the 
corresponding analog implementation (See Section V) these results 
correspond to a value of L = 20 (and K = 1) with a corresponding 
delay of 16.6 /xs. 

It is clear that the normalized nature of the curves in Fig. 3 facilitates 
their use in a wide variety of ways. For example, one could easily 
answer questions such as: 

(i) For a given class of signals, what is the smallest bit rate that 
can be used to guarantee an error not exceeding a prescribed 
level? 
(it) For a given bit rate, what is the largest class of signals that can 
be handled with a maximum error not exceeding a prescribed 
level? 

In the next section, analogous results are developed for some 
important classes of random input signals. 

IV. SOME IMPORTANT CLASSES OF RANDOM INPUTS 

In this section we consider the case where fl is the space of zero 
mean second-order random variables* with norm given by 

11*11 - (Ex 2 )* =a mi xzQ. (17) 



* There is no loss of generality in the zero-mean assumption. 
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Then 

B.{M) = [u:uzB., u(t) t SI, <r u(0 ^ M }. (18)* 

Thus B a (M) consists of second-order random processes (with o- u(() ^ M) 
with sample functions which are all in B a . For the important special 
case of wide-sense stationary random processes, a u(l) = a u . For this 
case, the quantizer mil be characterized by the property that it mini- 
mizes the mean-squared error at the sample times. The problem of 
designing such a quantizer for a given probability distribution of the 
input amplitude has been considered by B. Smith. 6 An approximate 
upper bound on the optimized quantizing error is given by 

a Q £ f. 9* a Q = ± ^| [jT pKu) dtij (19) 

where p(u) is the probability density function of u(t). The corresponding 
quantizer is described in Ref . 6. 

For the important cases where p(u) is uniform, gaussian, or expo- 
nential, ff g can be written in the form 

ff, = ^ (20) 

where iv„ is a constant depending on the particular distribution func- 
tion. Table I gives the value of K for each of the input classes of 
interest. The bound on the system performance which is given by 
equation (11) can thus be written as 

ir 8L V8 2 

which is identical in form to the corresponding bound for the deter- 
ministic case [see equation (16)]. The use of the design-analysis 
curves of Fig. 3 for these cases is thus identical to the previously 
described deterministic case. 

It is interesting to note that for the case of a uniform amplitude 
distribution as well as the amplitude constrained input class, <r, = & Q 
and the optimal quantizer is a uniform quantizer. In each of these 
cases e ^ e. 

In the next section, the interpretation and implementation of the 
proposed algorithm will be discussed. It will be shown that the analog 
implementation takes the form of a PCM system where the sampling 



* More precisely, B a (M) = \u(-, ■): u(-, u) t B„, u(t, )tQ, \\u(t, -)ll S M\ 
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Table I — Input Signal Description* 



Deter- 
ministic 



|tt(OI ^ M 



K = 1 



Random 



Uniform 



p(u) = 



1 I 1 <- 
la 



|u| > a 

K a = 1 

a 
V3 



Gaussian 



P(«) = X s 

s/lir a„ 
exp (-«V2«r B ') 

K = 1.65 

M = a u 



Exponential 



exp ( — -\/2u/<r u ) 
K = 2.12 

M = <T U 



* All signals are in /?„. 

rate, quantizer and low-pass filter which is used to accomplish the 
decoding are carefully chosen. 

V. ANALOG RECONSTRUCTION IN THE UPCM SYSTEM 

In this section we discuss an analog reconstruction in the UPCM 
system. For the analog reconstruction, the system takes the form 
shown in Fig. 4. The identification of the low-pass filter results from 
the following analysis. 

If we first consider the response, 7j(t), of a causal, stationary filter 
[with impulse response h(t) ] to the input 



then 



**(0 = E Mjh) S(t - jh) 



g(t) = l T, u(jh)h(t - jh). 



(22) 



(23) 



We now consider h(t) to be a delayed, truncated (for negative times) 



u(t) 























LOW PASS 

FILTER 

IMPULSE 

RESPONSE 

h(t) 


SAMPLER 


U(jh) 


QUAN- 
TIZER 


u(jM 


BINARY 
CODING 


CHANNEL 


BINARY 
DECODING 


ftfjfO 


PULSE 
GENER- 
ATOR 



































9(t) 



Fig. 4 — Analog UPCM system. 
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version of 0(t) [see equation (3)] 

h(t) = 6(t - (L + l)h)S(t) = 6 L+l (t)S(t) (24) 

where $(t) is given in equation (3) and S{t) is the unit step. The 
response g(t) can thus be written 

[t/h\ 
git) = E WhWt - & + l)h). (25) 

If u(t), given in equation (5), were more accurately represented by 
[t/m+l 

m= E umeti), tt[o,T] (50 

jm—m 

then g(t), given by equation (6), would more accurately be repre- 
sented (for T = h) by 

9(t) = E u(]h)0,(t), tt[0,T]. (6') 

J — — CD 

Equation (6') can be made valid for all t with 

(l/Al+L + 1 

g(t) = E *W*#0). (26) 



Thus 



g(t - (L + l)fc) = E *(#)«*(* - (L + !)/>). (27) 



We thus see that the output g{t) of the filter, with impulse response 
h{t) given by equation (24), is a delayed version [delay of (L + l)h 
seconds] of the more accurate representation of g(t) given by equation 
(60- It should be noted that the more accurate representation of g(t) 
was obtained by truncating only future values in the infinite sum as 
opposed to truncating both past and future values. The corresponding 
error bound is reduced to 

|| u(t - (L + l)h) - g(t) || ^ ^^ + ^- (28)* 

This corresponds to the case K = 1 for the curves shown in Fig. 3. 
Figure 5 is a plot of 6 L+ i(t) and its transform 

6 L+ » = £ 6 L+1 (t) exp (-jut) dt. 



* This can easily be obtained by eliminating the second term in equation (38) 
which corresponds to truncation of past values. 
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Fig. 5— Curve shown for L — 4, 5 = 1/2. 
The causal impulse response h(t) can be written as 

h(t) = e L+i (t) - e L+1 (t)S(-t) 

where the second term represents the negative time tail of 9 L + \{t) . The 
corresponding transfonn is 

//(c) = e i+I (w) - #(«) (29) 

where 8(a) is the transform of 9 L+1 (t)S( — t). The transform of the 
causal filter is thus seen to be a slight perturbation (for L sufficiently 
large) of the low-pass characteristic of £+1 (w). 

VI. DISCUSSION 

In this paper, the design and analysis of a class of PCM systems has 
been considered. In arriving at these results, advantage has been taken 
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of the fact that the sampling rate is higher than the Nyquist rate. 
The approach taken in this paper takes advantage of the alternate 
representations of the input class which are made possible by the 
higher sampling rate and chooses one for which a good bound on the 
effects of quantization errors can be derived. 

In their present form the results which have been presented may be 
viewed as a step towards the study of peak error behavior of PCM 
systems. The extension of these results to input signals about which 
more information is available (e.g., power spectral information) is the 
next step towards providing a more generally applicable framework 
for the design and analysis of PCM systems where peak error is the 
natural criterion. 
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APPENDIX 

Derivation oj Error Bound for UPCM System 

The class B a of functions consists of entire functions of exponential 
order one and type <x which are bounded on the real axis. 4 It includes 
all functions in £ 2 (— m , °°) having finite radian bandwidth, cr, and all 
trigonometric polynomials of degree [a].* 

Any element in B„ has the representation 5 

<t) = E#)«f(0 (30) 

where 

So- . a 

sin r t sm t 

e(t) = 1 ~ 5 ^7^" , (3D 

1 - 8 l 1 - 8 l 

0,(0 = d(t - jh), h = w(1 ~ 8) - (32) 

c 



] denotes integral part. A trigonometric polynomial of degree [«r] has the form 



§ao + S (dk cos kt -\- bk sin kt). 

k-l 
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This representation is valid for any 8 t (0, 1), hence 8 may be chosen 
appropriately for each application. The parameter 5 will be called the 
fractional guardband since the time between samples is ir(l — 8) /a 
which is less than the time between samples t/<t which corresponds to 
the Nyquist rate. 

Let u(t) represent an approximation to u(t) in the interval 
[- T/2, T/2] obtained by truncating equation (30). Thus 

u(t) = £ «Gfc)»*(0 (33) 

,•--«■ 

and 

«(0 - u(t) = £ u(jh)d,{t). (34) 

l»l>JV 

Since u t B a (M), we have 

sup \\u(t) - u(t) || ^ M £ I **(fl I- (35) 

utBc(M) |j|>W 

Let 2N + 1 = T/h + 2L, T/h odd, and \j\> N, then f or 1 1 | ^ T/2, 



3 ~h 



Thus 



jup > ii ,(o - m ii * £ e {(,- - 1)" ! + (i + |)" }■ (37) 

Using the Sonin formula 7 to sum the remainder series in equation (37) 

yields 

sup \\u{t)-u{t)\\ 

Utfl„(M) 

To obtain a uniform bound for £ e [— 7/2, T/2], we observe that the 
right side of equation (38) is maximized for t = T/2. Using this and 
N + i = r/2ft + L yields 

sup sup 1 1 u(t) — u(t) 1 1 ^ -rrr , (39) 

tt[-T/2,T/2] uiB,(.M) I? "Jj 

where 
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K = 



T 

mil 

T 



1 < K f£ 2. 



Thus equation (39) represents a uniform bound on the truncation error 
associated with the finite sum approximation (33) to an arbitrary 
u c B a (M) over the time interval - T/2 ^ t ^ T/2. It is clear that this 
bound can be made arbitrarily small by appropriate choice of L, how- 
ever the quantity T + Lh represents the delay associated with the 
decoder and hence some compromise will generally be called for. 

To evaluate the error due to quantizing the sample values, it is con- 
venient to define the quantity ^4.(5) by 

A(8) = sup £ | 0,(0 |. (40) 

A (8) plays a crucial role in relating the effects of quantization error 
at sample times to the error between samples. In fact, one of the sig- 
nificant characteristics of the representation (30), which is not shared 
by the Cardinal series representation (for functions in W a c B a ) is 
the ability to establish a useful bound on A{h). To do this, we first 
apply the Cauchy-Schwarz inequality and obtain 



A(8) 2 g sup £ 



-oXKai ,=-c 



SUp £_, 

-a><(<m ,=-c 



8a ,, 
sln l- 8 (t 


- jh) 


5a (t 
{ 1 - 8 {t 


jh) 



sin 


a (t 


- jh) 


\P 




a (i 


jh) 


[ 1 


- 8 {t 



(41) 



The Parseval theorem for functions in B„ which are also in 
£ 2 (— m , co ) provides the following explicit evaluations 



E 



f 

sin 


a It 


- jh) 


1- 8 {l 


[ 1 


a (t 


jh) 


- 8 {t 



8a fj 


-jh) 


Sm 1 - 8 {L 


8a . 


jh) 


[ 1 - 8 (t 



= 1, 



(42) 



(43) 
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Hence 

A(o) ^ -±- (44) 

Consider a quantizer with 2" output levels. If we denote by g{t) 
the signal 



g(t) = £ d(jfc)*,(0, (45) 

where it(jh) represents the quantized value of u(jh), then 

u{t) - g(t) = E HJh) - udh^d^t) + £ u(jh)0M> (46) 

Since the maximum quantization error at sample times is <r Q (v), using 
equations (44) and (39) we obtain 

sup sup \\u(t) — g{t) II ^ —ps + a -t = e- t*7; 
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